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CROSS REFERENCE TO RELATED APPLICATION 



This application claims the priority of German 
Application No. 199 16 664.1 filed April 14, 1999, which 
incorporated herein -by reference. 

BACKGROUND OF THE INVENTION 

This invention relates to a method of processing X- 
ray images. Articles contained in a transilluminated 
object are made visible to an operator /observer on a 
monitor and markings are placed around earlier-defined 
articles . 

To facilitate the evaluation of an X-ray image of 
transilluminated objects for an observer, the X-ray image 
is automatically examined in the X-ray system based on 
various properties. In such an arrangement a software is 
searching in the transilluminated object for certain 
previously defined articles such as firearms, piercing 
weapons or explosives. 

A method of the above-outlined type is described in 
German Patent document 198 55 250.5. If such an article 



detected, the observer receives information that the 
article has to be more thoroughly investigated in the 
transilluminated object. Such an information is the 
marking of the discovered article on the monitor, for 
5 example, by drawing a circle or frame therearound. Since 
the detected articles are not recognized as a whole, about 
each detected article a marking is placed- An evaluation 
by the observer is made difficult if a plurality of such 
markings appear on the monitor. Such an event is of 
10 significant disadvantage for the observer if the run- 
through period is, for example, approximately 6 seconds. 

SUMMARY OF THE INVENTION 

15 It is an object of the invention to provide an 

improved method of processing an X-ray image in which the 
placed markings are optimized to facilitate the evaluation 
of an X-ray image for the observer. 

This object and others to become apparent as the 

20 specification progresses, are accomplished by the 

invention, according to which, briefly stated, the method 
of processing an X-ray image of articles contained in a 
transilluminated object and made visible for an observer on 
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a monitor screen, includes the following steps: Placing 
individual markings about the image of certain, previously 
determined articles and automatically and stepwise 
combining the individual markings into a final added 
marking if at least two individual markings mutually fit. 
The combining step includes the steps of comparing for fit 
mutually facing sides of two adjoining individual markings 
and determining a ratio of an overlapping area of the two 
adjoining individual markings to the total area of at least 
one of the two adjoining individual markings. 

The invention is based on the principle to 
automatically couple to one another the numerous visible 
markings, so that on the monitor only a single marking as 
the sum of the individual markings appears to thus provide 
for the observer a central marking to make possible a rapid 
and reliable evaluation concerning the article in the 
transilluminated object. The coupling of the markings is 
effected by a function which is inputted in the X-ray 
system and which combines the mutually fitting markings and 
places a combined marking into the X-ray image. Only 
markings which belong to one another are combined. Whether 
two markings belong to one another is determined by their 
spatial proximity and their overlap. 



According to an advantageous feature of the 
invention, joined markings may again be removed, for 
example, when the operator wishes to see the markings 
individually. Also, the extent of the combination of the 
markings may be adjusted. As a result, the markings may be 
shown unchanged or combined. Further, intermediate steps 
are possible in which case then maximum 2, 3, 3, 5, etc. 
markings may be coupled to one another, so that on the 
monitor two to three markings, etc. may be made visible as 
individual added markings. 



BRIEF DESCRIPTION OF THE DRAWINGS 



Figure 1 is a simplified schematic illustration of an 
X-ray system adapted to perform the method according to the 
invention . 

Figure 2 is a block diagram of a computer system in 
an X-ray system for performing the method according to the 
Invention. 

Figures 3a, 3b and 3c are visual representations for 
providing a common marking on the monitor. 



Figures 4a, 4b and 4c are visual representations of 
the method for removing the common marking from the 
monitor. 



DESCRIPTION OF THE PREFERRED EMBODIMENT 



Figure 1 illustrates an X-ray system having a 
conventional X-ray generator 1 and a detector 2, between 
which an object 3 to be transilluminated is positioned. 
The object 3 may be a piece of luggage in which various 
articles 4, 5, 6 are contained. Non-illustrated known 
components couple a computer system 7 with the detector 2 . 
The measuring results are made visible on a monitor 8 
and/or a printer 9 coupled to the computer system 7. 

Figure 2 illustrates the essential component groups 
of the computer system 7 for performing the method 
according to the invention. The output of the detector 2 
is connected with an image processing device 10 which is, 
in turn, connected with a marking memory 11 and a memory 12 
for the marking lists. The marking memory 11 is bi- 
directionally connected with the memory 12 and thus gains 
access to the marking list accumulated during the process. 
The marking memory 11 is provided with a sub-marking memory 



11.1 which will be described in more detail as the 
specification progresses. 

The method according to the invention is performed as 
follows : 

5 The X-ray generator 1 directs an X-ray beam FX1 

to the object 3 to be transilluminated. The X-ray beam FX1 
is weakened by the respective absorption behavior of the 
articles 4, 5, 6 in the object 3 as well as by the housing 
material of the object 3 and is received by the detector 2. 

10 The detector 2, for example, a line camera formed of a 
plurality of X-ray detectors, produces signals from the 
non-absorbed part of the X-ray beam and applies the 
signals, as image data information about the 
transilluminated object 3, to the computer system 7 for 

15 image processing. Such an inputting is performed 

preferably line-by-line and in a continuous manner. The 
image data are evaluated in a known manner in the image 
processing device 10 and are readied for a visual 
representation on a monitor. An X-ray image represented in 

20 this manner is composed of image dots having various 

properties, for example, a gray scale and material value 
from which the article 4, 5, 6 may be recognized. 
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In principle, about each detected article defined as 
dangerous, for example articles 4, 5, 6, automatically a 
respective separate individual marking Ml, M2, M3 is 
placed, as shown in Figure 3a. Thus, about the first- 
recognized article 4 the marking Ml and about the second- 
recognized article 5 a marking M2 is placed. Already at 
this point the two markings Ml, M2 are compared with one 
another by means of a function to determine whether the two 
markings Ml and M2 fit to one another. For this purpose 
the mutually fitting or mutually facing sides of the 
markings Ml and M2 are compared by means of coordinate 
comparison. The more these sides correspond to one another 
in position and length, the better their fit. The distance 
between the individual markings Ml and M2 must not exceed a 
previously set, variable limit value. 

In the present illustration the individual markings 
Ml and M2 are situated too far from one another so that no 
common marking is established. Both markings Ml and M2 are 
inputted into the list memory 12 as well as the sub-marking 
memory 11.1 of the marking memory 11. 

Approximately at the same time the detection of the 
article 6 and placing the marking M3 thereabout occur. In 
a further step the marking M3 is compared with the marking 



Ml, that is, it is determined whether the individual 
markings Ml and M3 mutually fit. Since both markings Ml 
and M3 overlap on the fitting sides, additionally the ratio 
of the common (overlapping) surfaces of the two markings Ml 
and M3 to the surface of the smaller of the two markings Ml 
and M3 is determined for verifying the mutually fitting 
sides. The greater the ratio the better the mutual fit of 
the markings Ml and M3. As shown in Figure 3b, the 
markings Ml and M3 are replaced by a new marking as an 
individual added marking Ml/3 in which the respective outer 
sides of the markings Ml and M3 yield the size of the new 
individual added marking Ml/3. To ensure that the 
individual markings Ml and M3 are not lost in the computer 
system, they are stored in the sub-marking memory 11.1 as 
sub-markings Ml and M3 of the individual added marking 
Ml/3. 

Approximately at the same time, the new individual 
added marking Ml/3 is compared for correspondence with the 
individual marking M2 from the marking list. As a result 
of such a comparison, a new marking Mg as a final added 
marking is applied to the monitor 8. As shown in Figure 
3c, the articles 4, 5 and 7 are found within the final 
added marking Mg. The individual marking M2 and the 



individual added marking Ml/3 become sub-markings of the 
final added marking Mg. Thus, for the observer there is 
obtained a well ascertainable X-ray image on the monitor 8 
on which advantageously only a single final added marking 
5 Mg is shown without, however, losing the relationships 
between the individual markings Ml, M2, M3 and the 
representation of the final added marking Mg on the monitor 
8. 

The information concerning the individual markings Ml, 
10 M2, M3 as well as their assignment as sub-markings in 

relation to the individual added marking Ml/3 and the final 
added marking Mg remain in the computer system 7 in the 
memory 12 as well as in the sub-marking memory 11.1. This 
makes it possible to again separately display, upon 
15 extinguishing the final added marking Mg, all sub-markings 
Ml and M3 of the individual added marking Ml/3 as well as 
the sub-marking M2 . For this purpose the final added 
marking Mg is removed by the operator from the monitor 8, 
for example, by pushbutton operation, whereupon the 
20 computer system 7 again renders visible the individual 

stored markings Ml, M2 (M3 is not shown) on the monitor 8, 
as shown in Figures 4a, 4b and 4c. 
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Such necessary information is taken in steps from the 
sub-marking memory 11.1 as well as from the marking list in 
the memory 12. The computer system 7 proceeds with the 
earlier-described steps in a reverse order. First it is 

5 determined which final added marking Mg was removed and the 
sub-marking memory 11.1 is searched for the individual, 
associated sub-markings. In this proceeding the sub- 
marking Ml/3 belonging to the final added marking Mg as 
well as the sub-marking M2 are found. The final added 

10 marking Mg is extinguished in the marking list and the sub- 
marking Ml/3 found in the sub-marking memory 11.1 and the 
sub-marking M2 are added to the marking list of the memory 
12. Further, by means of the software of the computer 
system 7 it is recognized that the sub-marking Ml/3, as an 

15 individual added marking, is composed of the markings Ml 
and M3, while the sub-marking M2 has no further sub- 
markings and thus represents an individual marking. In the 
marking list the individual added marking Ml/3 is 
extinguished and replaced by the sub-markings Ml and M3 

20 which are then inputted from the sub-marking memory 11.1 in 
the memory 12. The individual markings Ml, M2 and M3 are 
applied to the monitor 8 from the marking list and 
displayed thereon. In this manner the observer may decide 
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whether the common marking Mg or the sub- 
markings /individual markings Ml/3, M2 or only the 
individual markings Ml, M2, M3 f etc. should be shown on the 
monitor 8 . 

5 It is to be understood that upon detection of several 

articles, that is, more than the mentioned three articles 
4, 5 and 6 the set markings Ml, M2 and M3, etc. are 
compared with one another as long as no mutually fitting 
markings (individual added markings) are found. 

10 Several variants are feasible within the scope of the 

invention. Thus, the degree and combination of the marking 
may be set. With such a setting it may be achieved that 
the markings are not always combined or are only partially 
combined, that is, intermediate steps with respect to the 

15 degree of combination are possible. In this manner too, 

individual markings may be removed from the combined 
markings which will thus decompose into several parts. 

It will be understood that the above description of 
the present invention is susceptible to various 

20 modifications, changes and adaptations, and the same are 

intended to be comprehended within the meaning and range of 
equivalents of the appended claims. 
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What is claimed is: 



1. A method of processing an X-ray image of articles 
contained in a transilluminated object and made visible for 
an observer on a monitor screen, comprising the following 
steps : 

(a) placing individual markings about the image 
of certain, previously determined articles; and 

(b) automatically and stepwise combining the 
individual markings into a final added marking if at least 
two individual markings mutually fit; said combining step 
comprises the steps of 

(1) comparing for fit mutually facing sides 
of two adjoining individual markings; and 

(2) determining a ratio of an overlapping 
area of said two adjoining individual markings to the total 
area of at least one of said two adjoining individual 
markings . 

2. The method as defined in claim 1, wherein said 
comparing step comprises the step of comparing lengths and 
positions of said facing sides. 
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3. The method as defined in claim 1, wherein said 
step of determining a ratio comprises the step of 
determining a ratio of said overlapping area of said two 
adjoining individual markings with the total area of one of 
said two adjoining individual markings. 

4. The method as defined in claim 1, further 
comprising the step of storing said individual markings in 
a marking list of a memory; said combining step includes 
the steps of 

(a) forming an individual added marking from two 
individual markings resulting from said comparing and 
determining steps ; 

(b) storing said individual added marking in 
said marking list; 

(c) storing said individual markings, from which 
said individual added marking has been formed, from said 
marking list in a sub-marking memory of a marking memory as 
sub-markings of said individual added marking; 

(d) comparing said individual added marking with 
a further individual marking called from said marking list 
for forming a final added marking; 
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(e) adding said final added marking to said 
marking list; and 

(f) storing the individual added marking and the 
further marking, from which said final added marking has 
been formed, in said sub-marking memory as sub-markings of 
said final added marking, whereby structures of said sub- 
markings are preserved. 

5. The method as defined in claim 4, wherein said 
combining step further comprises the step of setting a 
degree in combining said individual markings for providing 
an option to display one of individual added markings and 
individual markings instead of a sole final added marking. 

6. The method as defined in claim 5, further 
comprising the steps of adding the structure of the 
individual markings and the individual added markings from 
the sub-marking memory to said marking list if one of 
individual added markings and individual markings are 
displayed instead of a sole final added marking. 

7. The method as defined in claim 1, wherein said 
comparing and determining steps include the step of 
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comparing coordinates in which said individual and 
individual added markings are positioned. 
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ABSTRACT OF THE DISCLOSURE 

A method of processing an X-ray image of articles 
contained in a transilluminated object and made visible for 
5 an observer on a monitor screen, includes the following 
steps: Placing individual markings about the image of 
certain, previously determined articles and automatically 
and stepwise combining the individual markings into a final 
Cj added marking if at least two individual markings mutually 

10 fit. The combining step includes the steps of comparing 
" Z U for fit mutually facing sides of two adjoining individual 

J markings and determining a ratio of an overlapping area of 

|jj the two adjoining individual markings to the total area of 

D at least one of the two adjoining individual markings. 

13 15 
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DECLARATION FOR UNITED STATES PATENT APPLICATION, Attorney Docket 

POWER OF ATTORNEY, DESIGNATION OF CORRESPONDENCE ADDRESS 31659-157399 

As a below named inventor, I hereby declare that my residence, post office address and citizenship are as stated 
below next to my name, and that I believe I am the original, first and sole inventor (if only one name is listed below) or 
an original, first and joint inventor (if plural names are listed below) of the subject matter which is claimed and for 
which a patent is sought on the invention entitled METHOD OF PROCESSING X-RAY IMAGES the specification of 
which 

[X] is attached hereto* 

[] was filed on as Application No, _ 

and was amended on [if applicable]. 

[] was filed under the Patent Cooperation Treaty on , 

Serial No. , the United States of America being designated, 

I hereby state that I have reviewed and understand the contents of the above identified specification, including the 
claims, as amended by any amendment referred to above. 

I acknowledge the duty to disclose to the Patent and Trademark Office all information known to me to be material 
to patentability as defined in Title 37, Code of Federal Regulations, § 1.56(a). 

I hereby claim foreign priority benefits under Title 35, United States Code, §119 of any foreign application(s) for 
patent, utility model, design or inventor's certificate listed below and have also identified below any foreign 
application(s) for patent, utility model, design or inventor's certificate having a filing date before that of the 
fi|ppIication(s) on which priority is claimed: 



JRumber 


Country 


Date Filed 


Yes No 


J99 16 664.1 


Germany 


April 14, 1999 
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J hereby appoint the following attorneys to prosecute this application and to transact all business in the Patent and 
IfTrademark Office connected therewith: George H. Spencer (Reg. No. 18,038), Norman N. Kunitz (Reg.No. 20,586), 
JRobert J. Frank (Reg. No. 19,112), Gabor J. Kelemen (Reg. No. 21,016), Robert Kinberg (Reg. No. 26,924), John W. 
pchneller (Reg. No. 26,031), Ashley J. Wells (Reg. No. 29,847), Allen Wood (Reg. No. 28,134), P.O. Box 34385, 
a Washington, D.C. 20043-9998, Telephone: (202) 962-4800, Telefax: (202) 962-8300. Address all correspondence to 
□TENABLE, BAETJER, HOWARD & CIVILETTI, LLP, P.O. Box 34385, Washington, D.C. 20043-9998. 
||j The undersigned hereby authorizes the U.S. attorneys named herein to accept and follow instructions from the 
Wkndersigned's assignee, if any, and/or, if the undersigned is not a resident of the United States, the undersigned's 
rpomestic attorney, patent attorney or patent agent, as to any action to be taken in the Patent and Trademark Office 
fjegarding this application without direct communication between the U.S. attorneys and the undersigned. In the 
Invent of a change in the person(s) from whom instructions may be taken, the U.S. attorneys named herein will be so 

notified by the undersigned. 

I hereby declare that all statements made herein of my own knowledge are true and that all statements made on 
information and belief are believed to be true; and further that these statements were made with the knowledge that 
willful false statements and the like so made are punishable by fine or imprisonment, or both, under §1001 of Title 18 
of the United States Code and that such willful false statements may jeopardize the validity of the application or any 
patent issued thereon. 
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